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Abstract. The upper extremes of a Markov chain with regulary varying sta- 
tionary marginal distribution are known to exhibit under general conditions 
a multiplicative random walk structure called the tail chain. More generally, 
if the Markov chain is allowed to switch from positive to negative extremes 
or vice versa, the distribution of the tail chain increment may depend on 
the sign of the tail chain on the previous step. But even then, the forward 
and backward tail chain mutually determine each other through a kind of 
adjoint relation. As a consequence, the finite-dimensional distributions of 
the Markov chain are multivariate regularly varying in a way determined by 
the back-and-forth tail chain. An application of the theory yields the asymp- 
totic distribution of the past and the future of the solution to a stochastic 
difference equation conditionally on the present value being large in absolute 
value. 
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1 Introduction 

Consider a discrete-time, real-valued random process {X t : t = 0, 1, 2, . . .} 
defined by the recursive equation 

(1.1) Xt = *(X t - U e t ), i = 1,2,..., 
where 

(1.2) (i) E\, £2, ■ ■ ■ are independent and identically distributed random 

elements of a measurable space (§,<S) and independent of Xq; 

(ii) \P is a measurable function from R x § to R. 
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If the process {Xt} happens to be stationary, it will be assumed to be defined 
for all integer t. The distribution of Xq is assumed to be regularly varying. 

Aim of the paper is to find the weak limits of the finite-dimensional dis- 
tributions of the process conditionally on Xq being large in absolute value. 
More precisely, we will investigate the weak limits, called the forward tail 
chain, of vectors of the form (Xq, . . . , Xt) given \Xq\ exceeds a high thresh- 
old. If in addition the process is stationary, we will extend to this to find 
the back-and-forth tail chain, which corresponds to the weak limits of vec- 
tors of the form (X_ s , . . . ,X t ) given \Xq\ is large. As a consequence, the 
finite-dimensional distributions of the process {Xt } will under quite general 
conditions be found to be multivariate regularly varying. 

The process {Xt} is obviously a discrete-time homogeneous Markov 
chain. Every homogeneous discrete-time Markov chain {Xt} can be rep- 
resented as in (|l.ip - (|1.2p . Of course, for a given Markov chain {Xt} the 
above representation is not unique. Still, in examples, the way in which 
Markov chains are defined is often through a recursive equation; all exam- 
ples in Goldie [7|, pp. 126-127], for instance, are of this type. The chain is 
stationary if and only if X\ = ^(Xq, e\) and Xq are equal in law. 



In Smith [15] and Perfekt ll|, excursions of a Markov chain over a 



high threshold are shown to behave asymptotically and under quite gen- 
eral conditions as a (multiplicative) random walk. The theory has been 
extended to multivariate Markov chains in Perfekt [13] and to higher-order 
Markov chains in Yun [3, Qji]. The random- walk representation is useful 
from a statistical perspective because it give s a handle on how to model 
the extremes of certain time series 0, IR lid], A useful, well-investigated 
class of processes for which the random walk structure is quite revealing are 
the stationary solutions to certain stochastic difference equations, including 
squared autoregressive conditionally heteroskedastic (ARCH) processes as a 
special case j3,H, @|. 

A limitation of the theory of Smith 15|] and Perfekt 11] is that it ex- 
cludes Markov chains for which extreme values can switch from the upper 
to the lower tail or vice versa, as can be observed for instance in time series 
of logreturns of prices of financial securities in periods of high volatility. For 
such Markov chains with tail switching potential, the random walk repre- 
sentation of excursions over high thresholds breaks down in the sense that 
the distribution of the multiplicative increment now depends in general on 
the sign of the chain on the previous step. In Bortot and Coles [4(, a more 
general representation is postulated, involving in fact four transition mech- 
anisms rather than one, corresponding to the four cases of transitions from 
and to upper or lower extreme states. 
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The novelty of the paper is two-fold: first, to derive an elementary condi- 
tion on the recursive mechanism (jl.ip under which the random walk repre- 
sentation or the more general tail-switching representation holds, including 
a simple description of the latter; second, in the stationary case, to study the 
joint distribution of the forward and backward tail chain, coined the back- 
and-forth tail chain. Besides the assumption that the distribution of Xq is 
regularly varying, the only condition is a relatively easy-to-check statement 
on the asymptotic behaviour of ^f(x, ■ ) for large 

The outline of the paper is as follows. The forward tail chain of a possibly 
non-stationary Markov chain is studied in section [2j Section [3] describes a 
kind of adjoint relation between bivariate distributions that serves to define 
a class of processes, coined back-and-forth tail chains, in section 01 which 
in turn characterize the joint forward and backward tail chains of certain 
stationary Markov chains in section [5j Multivariate regular variation and 
maximal domains of attraction are studied in section [H Finally, section [7] 
provides some examples and counterexamples to the theory, including an 
application to stationary solutions of stochastic difference equations. 

To conclude this section, let us fix some notations. For real x and y, 
put x V y = max(x, y) and x A y = min(x, y). For < a < oo and x £ R, 
denote (x)°L = (xV0) a . The law of a random vector X is denoted by C(X); 
weak convergence of probability measures is denoted by The probability 
measure degenerate at a point x is denoted by 5 X . The indicator of an event 
A is denoted by 1(A). 



Let Xq,Xi,X2, ■ ■ ■ be a homogeneous Markov chain as in (jl.ip and (|1.2p . 
not necessarily stationary. The focus of this section is on the asymptotic 
distributions of the finite-dimensional distributions of the process condition- 
ally on \Xq\ being large (Theorem I2.3j) . As a side result, the joint survival 
function of (Xq, . . . , Xt) is found to be multivariate regularly varying in all 
2 <+1 corners of R* +1 (Condition 12.41) . Two conditions are required: Condi- 
tion [2J] on the tails of Xq, and Condition 12.21 on the asymptotics of ^f(x, • ) 
for large 

Condition 2.1. There exists < a < oo such that 



2 Forward tail chain 





< y < oo. 
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Moreover, there exists < p < 1 such that 
(2.2) 



r PjXo > x) 
lim — - — , r = P- 



P(\X \>x 

Denote p(+l) = p and p(— 1) = 1 — p. 

Condition 2.2. There exists a measurable subset V of § with P(ei G 
V) = 1 such that for every a € {—1,1} with p(cr) > and every v G V the 
following limit exists: 



(2.3) 



lim x 1 ^'(x, v) 



lv, a 



Moreover, if P[^>(ei, a) = 0] > for some a, then also P(ei G W) = 1, 
where W is a measurable subset of V such that for all v G W, 



(2.4) 



sup \^(y, v)\ = O(x), 

\v\<x 



x — > oo. 



Theorem 2.3. Let {X t } be given by (fTTT|) - (fL"2"j) . If Conditions HOI and 
\2.2\ hold, then for every integer t > 0, as x — > oo, 



(2.5) £ 

with 
(2.6) 



\Xa\ \Xn 



Xn 



\Xn\ > X 



C(Y,M ,M 1 ,...,M t ) 



j = l,2,... 



Mj = M i _i0(e i ,signM i _i) ; 
where <p{ ■ , 0) =0 and 

(2.7) (i) Y, Mo, £\, &2i ■ ■ ■ are independent with e t as in l\1.2^ (i); 

(ii) P(Y >y)= y~ a for y > 1; 

(Hi) P(M = a) = p{a) for a G {-1, 1}. 

Proof. The argument is by induction on t. The case t = is a straightfor- 
ward consequence of Condition 12.11 So let t be a positive integer and let 
/ : ]R* +2 — > 1R be bounded and continuous. We have to show that 



(2i 



lim E 

rr^oo 



J { x '|X |'---'|X | 



IXnl > X 



E[f(Y,M ,...,M t )]. 
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By (EU), if X ^0, 



|X n 



Hence, 
(2.9) 

where 
(2.10) 

Define 
(2.11) 
By (123 
(2.12) 



E 



o 



E 



x y 

X \ 



Xo 

\Xn 



\*o\ 
X \ > X 

X t -i 



\x { 



o 



Xo\ > x 



g x (y,x , . . .,x t -i) = E 



f[y,x ,.. ,,x t -i 



xy 



g{yx , x t -i) = E[/(y, x ,..., x t -i, x t -i<f>(et, sign 



E[/(Y, M , ... , M)] = E[s(Y; M , ... , M t -i)]. 

In view of the identities (|2.9h and (I2.12D , the limit relation in (12. 8h will follow 
if we can show that 

\Xq\ Xq Xt-i 



(2.13) E 



\X< 



o 



IX 







Xq\ > x 



Eb(y,Mo,...,M_!)] 



as x — > oo. In turn, f)2. 13j) will follow from the induction hypothesis and an 
extension of the continuous mapping theorem Theorem 18.11] provided 



(2.14) 



lim 5 x (?/(x),xo(x), . . .,x t -i(x)) = g(y,x , . . .,x t -i) 



whenever y(x) — > y and Xj(a;) — > x« as x — ► co with (y, xo, . . . , a^t-i) ranging 
over a set £ C R t+1 with P[(Y, M , . . . , M t _i) e£] = 1. From the defini- 
tions of and g in (|2,10p and ()2.1ip , respectively, equation (|2.14p is implied 
by 

(2.15) «- 



lim 

z— >oo 



w0{v, sign u; 



whenever linx^oo w(z) = w and where w and i> range over sets that receive 
probability one by the distributions of M t -\ and e\, respectively. But (|2.15p 
is ensured by Condition 12.21 If w ^ 0, then (|2.15p follows from (|2.3p . The 
case w = arises only if P(Mi_i = 0) > 0; in turn, the latter can only occur 
if P[<p(ei, a) = 0] > for some a, and then <|2.15j> is guaranteed by (12. 4p . □ 
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Corollary 2.4. Under the conditions of Theorem \2.3l for every integer 
t > and all xq, . . . , xt 6R, 

lim p(^.>^...,»^>») _ E[ „ A . . . A { t)?] 

rc^oo F(|Aq| > x) 

Proof. If xo = 0, then both sides of fl2.16j) are zero. So assume xq ^ 0. By 
Theorem 12.31 and the continuous mapping theorem, as x — > oo, 



X \>x) ~> £{YM , YMi, YM t 



\ X X X 

Hence, as the distribution of Y is continuous, the limit on the left-hand side 
of (I2.16P is equal to 

lim P( |5|'^ :C/l ? l) P(^o > x,...,x t X t > x \ \X Q \ > x/\x \) 

x^co P(|Ao| > x ) 

= \x \ a P(x Q YM > \x \,xiYM x > \x \,...,x t YM t > \x \). 

It remains to show that this expression is equal to the right-hand side of 
(|2.16p . Since the variable Y is independent of (Mq, . . . , Mt) and Y~ a is 
uniformly distributed on (0, 1), the above expression is equal to 

\x \ a f P[(x M )^ > |x r«,(xiAfi)^ > \xo\ a u,...,{x t M t )% > \x \ a u]du. 
Jo 

Change variables v = \xo\ a u and use \Mq\ = 1 to simplify this to 

P[(x M )^ > v, . . . , {x t M t )% > v]dv = E[(x M )^ A • • • A (x t M t )%], 

as stated. □ 

In Gomes et al. Theorem 2.1], equation (|2.16p is derived for stationary 
solutions to certain stochastic difference equations and positive Xj. 



3 An adjoint relation between bivariate distributions 



The purpose of this section is to prepare the ground for the definition of back- 
and- forth tail chains in section [U which in turn will show up in Theorem l5.2l 
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the main result of the paper. For < p < 1 and < a < oo, consider the 
following set of probability measures on {-1,1} x 1: 

(3.1) M Pt a is the set of distributions /i of bivariate random vectors (I, M) 
with the property that 

(i) P(/=l)=p=l-P(/=-l); 

(ii) E[{aM)%] < P(J = a) for a € {-1, 1}. 

Two measures fi, fi* G M p>a are said to be adjoint if, whenever C(I, M) = fj, 
and £(J*,M*) = //*, 

(3.2) E[(zi)» A (yM)°] = E[(xM*)« A (j,/*)"], x, y G R. 

Clearly, the relation ". . . is adjoint to ... " is symmetric. 

Proposition 3.1. For every fi G M. p , a there exists a unique fx* G A4 Pta 
that is adjoint to [i. If C(I,M) = \i and C(I*,M*) = [i* , then for M* - 
integrable functions f and for a G { — 1,1}, 

(3.3) E[l(I* = a)f(M*)] 

= E[f(I/\M\)(aMr + ] + {P(J = a) - E[(,M)«]}/(0). 

Proof. Let fi G M Pt a and C(I,M) = [i. Define a probability measure /i* on 
{-l,l}xMby 

M*({(a,0)}) = P(I = a)-E[(aM)%) 

I 



At* ({a} x E) = E 



M\ 



G E (o-M)l 



for a G {-1, 1} and Borel sets ficR \ {0}. 

Let (I*,M*) be a random pair with law //*. By definition, equation (|3.3|) 
holds for measurable indicator functions /. By linearity, ()3. 3f) then also holds 
for measurable step functions, and therefore, by monotone convergence, for 
measurable nonnegative functions. Finally, by linearity, (|3.3[) must hold for 
arbitrary M*-integrable functions. 

The measure n* belongs to M. p>a because, by (13. 3p . P(J* = a) = P(J = 
a) and E[(aM*)^] = P(I = a, M ^ 0) for a G {-1, 1}. Moreover, fi* solves 
(|3.2p , since the latter equation is a special case of (|3.3p applied to a = sign y 
and f{m*) = (im*)" A \y\ a . 
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To see that the solution of (|3.2p is necessarily unique, argue as follows. 

For 

E[(iM*)" A (yl*)+] = E[1(J* = signy)(xM*)" A \y\ a ] 



rwr 

1(1* = signy) / l(xM* > z 1/a )dz 
Jo 

r\y\ a 

/ P(J* = signy, iM* > z 1/a )dz. 
■/ o 



Therefore, knowledge of the function (x,y) t— > E[(xM*)" A (yJ*)?] implies 
knowledge of /x* on {-1, 1} x (R \ {0}). Since also /x*({l} x R) = p and 
fi*({ — 1} xR) = l- j>, equation (j3.2|) uniquely determines fx*. □ 



Let /x = C(I,M) and /x* = £(I*,M*) be adjoint in _M PiCt . By 

P(J* = a, sign M* = r) = E[l(/ = r)((xM)«], <t,t G {-1,1}, 

and in particular P(M* ^ 0) = E[|M| Q ] and vice versa. For a <G {—1,1} 
such that P(J = a) > 0, 

(3.4) E[/(M*/r) | I* = a] 



-E[/(J/M)(crM)-] + (l - p [ ( ( jy+ ] )/(0), 



P(J = a) 
and vice versa. As a consequence, 

(3.5) E[/(M*/r)] = E[/(//M)|M| a ] + (1 - E[|M| a ])/(0). 

If additionally E[|A/| Q ] = 1, then E[{aM)%] = P(J = a) for <r G {-1,1} 
by (|3.ip (ii). making the second terms on the right-hand sides of (13, 4p and 
(13.51) vanish. 



Example 3.2. Let /x = IZ) where / and Z are independent random 
variables with P(I = 1) = 1/2 = P(J = -1) and E[\Z\ a ] < 1. Then 
(j, G and by (|3.4p . its adjoint, /i*, is the distribution of (I*,I*Z*) 

where J* and Z* are independent random variables with I* equal in law to 
/ and with the distribution of Z* and Z mutually determining each other 
via 

(3.6) E[/(Z*)] = E[f(l/Z)\Z\ a ] + (1 - E[|Z| a ])/(0) 

and vice versa; see also Example 17. 11 
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Example 3.3. A useful special case of Proposition 13. II arises if p = 1. If 
{J, € A4i t a, then /i({l} x [0, oo)) = 1, so we can write \x = 5\ ® v for some 
probability measure v on [0, oo) such that L, ^ x a u{dx) < 1. The adjoint 
of ji in A4i t a is n* = 8\® v* where v* is the probability measure on [0, oo) 
related to v via 

(3.7) E[/(Z*)] = E[/(1/Z)Z Q ] + (1 - E[Z Q ])/(0) 

and vice versa, where C(Z) = v and C(Z*) = v* . Some examples of pairs 
(u, u*) are the following: 

• For every a, if v is concentrated on {0, 1}, then v* = v. 

• If a = 1 and v is the distribution of a unit exponential random vari- 
able, then v* is the distribution of the reciprocal of the sum of two 
independent unit exponential random variables. 

• If a = 1 and v is the distribution of a lognormal random variable with 
unit expectation, then v* = v. 

Except for a change of sign, the case p = is similar to the case p = 1. 

Example 3.4. Let \x be the law of (I,M) where P(J = 1) = p = 1 — 
P(7 = — 1) for some < p < 1 and 

C{M/I | J = ±1) =pi<5i +p <5o +P-i<L_{(i_p)/p}±iA* 

for some < a < oo and some p-±,po,pi £ [0,1] with p_i + po + Pi = 1- 
Then // G -M P)Q , and the adjoint of in -M P) a is /i itself; see also Example 17. 31 

4 Back-and-forth tail chains 

In this section, the preparation of Theorem 15.21 is continued through the 
study of a certain class of discrete-time processes. Recall the set M. p>a m 
(|3.1h and the adjoint relation in (13. 2\\ . 

Definition 4.1. A discrete-time process {Mt : t £ 7*} is said to be a 
back-and-forth tail chain with index < a < oo and forward transition law 
H £ A4 P; a, notation BFTC(a,/i), if 

(i) C(M ,M 1 )= f x; 



(ii) £(Mq,M_i) = fi* is adjoint to p, in M. Pt , 
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(ii) for all integer t > 1 and all real Xt-i,Xt—2, ■ ■ ■ 



C(M t | M t _! = x t _i, M t _ 2 = Xt_2, • • •) 

f £(i t -iMi/M | M = signx t _i) 
I 5o 



i/a;t-i / 0, 
ifxt-i = 0; 



(mj for all integer t > 1 and a// rea/ x_t+i, x-t+2, ■ ■ ■ 



C{M_ t | M_ m = x_ t+1 , M_ t+2 = . . .) 

f £(ar_ H iM_ 1 /M | M = signx_ t+1 ) 
I <5o 



ifx-t+i + °> 
ifx- t+ i = 0. 



If = (5i ^ € A^i,o! as in Example 13,31 we also write bftc(o, v). 

Clearly, {M t : t G Z} is a BFTC(a, fj,) if and only if {M_ t : t £ Z) is a 
BFTC(a,/x*). Necessarily P(M = 1) = p = 1 - P(M = -1). 

Let < p < 1. For /z E -M PiQ with adjoint /i* € A^p, a , a process 
{Mt} is a BFTC(a,//) if and only if it admits the following distributional 
representation: for integer t > 1, the variables Mt and M_t are recursively 
given by 



(4.2) (i) M ,A 1 ,A- 1 ,A2,A-2,...,Bi,B-. 1 ,B2,B^2,--- are indepen- 



(ii) P(M = 1) = p = 1 - P(M = -1); 

(iii) £(4 t ) = £(A X ), C(A- t ) = C{A-i), C{B t ) = C(Bi) and 
C(B-t) = £{B-x) for integer t > 1; 

(iv) £(M ,Mi) = /i and £(M ,M_i) = /i*. 

The laws ^4_i and -B_i in (j4.2j) can be expressed in terms of (a,[i) through 
([331): since C(A- X ) = £(M_x \ M = 1) and C(B^) = £(-M_ x | M = 



(4.1) 




here 



dent; 
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— 1), for suitably integrable /, 
(4.3) 

P [ \Mi 
E[/(B_!)] = — — — E 



(Afi 



1 — p 



+ 1 



E[(M 



(-Mi)! 



+ 1 



P 



7(0), 



E[ (-Mi)E 
1 — p 



/(0). 



On the other hand, if p = 1 and /U = o"i ® v £ «Mi a with adjoint 
H* = 5\ ® v* , a process {Mt} is a BFTC(a,z/) if and only if it admits the 
following distributional representation: 



(4.4) 



1. 



M 

M ±t = uLi A ±h inte g er < > i 5 

where 

(4.5) (i) i4i, ^4-2, • • • are independent; 

(ii) C(A t ) = v and C(A^ t ) = v* for integer t > 1. 

The case p = is similar to the case p = 0. 

The above representations imply that if {Mt} is a BFTC(a,p), then 



(4.6) 



E[\M t \ a ] < 1, 



t € 



The following proposition states a remarkable identiy for back-and-forth 
tail chains. This identity will play a crucial role in the proof of Theorem 15. 21 

PROPOSITION 4.2. Let [i e A4 P>Q and Zei {M t : t e Z} be a BFTC(a,p). 
For integers s > 1 and i > and /or every bounded, measurable function 
f : R s +' +1 — > R snca iaai f(x- s ,...,xt) = as soon as x_ s = 0, i/ie 
num&ers 



(4.7) 



E 



/ 



Mi 



t + i 



Mi 



M, 



I Mi 



0,...,s 



are a// i/te same. 



Proof. Note that it is sufficient to show that the numbers in (|4.7p corre- 
sponding to i = and i = 1 are the same, that is, 



(4.8) 



E[/(M_ S ,...,M)] =E 



/ 



M. 



s+l 



|Mi| 



Mm 
I Mi I 
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For, if (|4.8p is true for all integer s > 1 and i > 0, then an application of 
with s and t replaced by respectively s — j and t+j for some j = 0, . . . , s — 1 
shows that the expectation in (|4.7p corresponding to i = j is equal to the 
expectation in (|4.7p corresponding to z = j + 1. 

We focus on the case < p < 1, the proofs for the cases p = or p = 1 
being similar but simpler. Without loss of generality, we assume that the 
process {M t } is given as in (|4.ip and (14. 2|) . The proof of (14. 8p proceeds in 
two steps. 

Step 1: s = 1. Let / : M' +2 — > R be bounded and measurable and such 
that /(0, xq, • • • , x t ) = 0. We have to show that 



(4.9) 



E[/(M_i M t )]=E 



/ 



M 
I Mi I 



M 



i+l 



I Mi 



The proof is by induction on t. For t = 0, equation (|4.9p reduces to ()3.3|) . 
Let t > 1. Since M t = M t _iA t l(M t _ 1 > 0) + M t _ 1 S t l(M t _i < 0), 



E[/(M_i,...,M t )] 



E[/(M_i, . . . , M t _ 1) M t _ 1 A t )l(M t _ 1 > 0)] 
+ E[/(M_i, . . . , M t _!, M t _ifl t )l(M t _i < 
+ E[/(M_i, . . . , Af t _!, 0)1 (M t _! = 0)]. 



The variables ^ and are independent of the vector (M_i, . . . , M^_i). 
Hence, the above expectations do not change if A t and B t are replaced by 
At+i and -Bt+i, respectively. Condition on At+\ and Bt+\ and apply the 
induction hypothesis to see that the above expression is equal to 



E 

+ E 
+ E 



M 


M t 


A t+ i 


M t 


W 


''\Mi\ 


|M X | 


M 


M t 


Bt+i 


M t 


W 


"\Mi\ 


\Mi\ 


M 


M t 


°y 


( M t 


|Mi|'" 


' ' |Mi| 


\\M X 



\\Mi\ 
JMi_ 
\\Mi\ 

= | [Mi 



> 0j\Mi\ a 
<o]\M 1 \ a 



As M i+ i = M t A t+ il(M t > 0) +M t 5 i+ il(M 4 < 0), the above expression 
can be simplified to the right-hand side of (|4.9p . as was to be shown. 

Step 2: general s and t. We proceed by induction on s. The case s = 1 
was treated in step 1. Let s > 2. Since M_ s = M_ s+ it1_ s 1(M_ s+ i > 
0) + M_ s+ i5_ s l(M_ s +i < 0) and since /(M_ s , . . . , M t )l(M_ s = 0) = 0, 



E[/(M_ s ,...,M t )] 



E[/(M_ s+ iA_ s ,M_ s+ i,...,M t )l(M_ s+ i > 0)] 
+ E[/(M_^iS_ a , M_ a+ i, . . . ,M t )l(M_ a+ i < 
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Note that (A- s , B- s ) is independent of (M_ s +i, . . . , Mt). Conditionally on 
A_ s and B_ s , apply the induction hypothesis on the vector (M_ s +i, . . . , Mt) 



to rewrite the above expression as 



E 



E 



M_ 



s+2 



| Mi | 



M_ 



s+2 



Mi 



-B- 



\Mi\ ' 
M_ s+2 



I Mi 



M 



t+i 



\M X \ 

Mt+i 
|Mi| 



M_ 



5 + 2 



|Mx| 
M_ s+2 



I Mi 



>0)|M 1 | Q 
: (> IMiT 



The two expectations in the above display do not change if A_ s and B_ s 
are replaced by A_ s+ i and £>_ s+ i, respectively. By definition of M_ s +i, the 
above expression is then indeed equal to the right-hand side of (|4.8|) . □ 

A special case of equation (|4. T[) is that, for every integer s > 1 and every 
xo, • • • , x s GR, the numbers 

E[(x M)^ A (xiMi_i)? A • • • A [x a Mi-,)%], i = 0,...,s 

are all the same. 



5 Back-and-forth tail chains of stationary Markov chains 

From now on, the process {Xt} in (jl.ip and (jl.2p is assumed to be strictly 
stationary. A necessary and sufficient condition for stationarity is that 

(5.1) C(*(X ,e 1 )) = £(X Q ). 

It may be highly non-trivial to find the law for Xq that solves ()5.ip . But 
even when the stationary distribution does not admit an explicit expression, 
its tails may in many cases be found by the theory developed in Goldie 0]. 

If the process {Xt} is stationary, then by Kolmogorov's extension theo- 
rem, the range of t can without loss of generality be assumed to be the set of 
all integers, Z. Our aim is to extend Theorem 12.31 and find the asymptotic 
distribution of (X~ s , . . . , Xt) conditionally on \Xq\ > x for all integer s and 
t (Theorem E2J). Recall the process M , M x , M 2 , . . . in <^Mj and $Tl§ and 
recall the set M. p , a in (|3.ip . 

Lemma 5.1. Let {Xt : t € Z} be a stationary Markov chain with distri- 
bution determined by (jl.ip . (|1 .2j) and (|5,ip . If Conditions and [2J% hold, 
then 

E[((7Mi)«]<p(*). a €{-1,1}, 
that is, £(M ,Mi) G 
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Proof. Fix a E {-1,1}. By (|2T2|) . 

lim P(aX > x \ \X \ > x) = p(a). 

x^oo 

Fix 5 > 0. By stationarity, equation (|2.ip . and the case t = 1 in Theorem 12. 31 
p(a) > lim PflXol > 5x,aXi > x \ \X\\ > x) 

X—fOO 

P(\X \ > Sx)^, . 

:c^oo P(|Ai| > x) 

= <r a P[crMi > (5Y)- 1 }. 

Since the distribution of the random variable Y~~ a is uniform on (0, 1), the 
right-hand side in the previous display is equal to 

5~ a [ P[(aMx)% > S- a u]du = [ P[(aMx)% > v]dv. 
Jo Jo 

For every 5 > 0, the integral on the right-hand side of the previous display 
is bounded from above by p(cr); hence the same must be true for its limit as 
6^ oo, which is E[(<rMi)£]. □ 

Recall Definition 14. II of a back-and- forth tail chain. Apart from station- 
arity, the conditions on the chain {Xt} are identical to those in Theorem 12. 31 

Theorem 5.2. Let {Xt : t E Z} be a stationary Markov chain with 
distribution determined by (II. 1|) . (|1.2p and (|5.ip . If Conditions POl and Wl^ 
hold, then for all nonnegative integer s and t, as x —* oo, 



(5.2) 

with 
(5.3) 



C 



\x a \ x_ 



\Xo\ 



X \>x) ~*C{Y,M- a ,...,M t 



(i) Y is independent of {Mt : t E Z}; 

(ii) P(Y >y) = y~ a for y > 1; 

(mj {M t : t E Z} is a BFTC(a,/i) w;/iere /i = £(M ,Mi) imi/i 
(M , Mi) as in ((OJ) and (ETT1) . 

Proof. By Lemma 15.11 the law of (Mo, Mi) belongs to A4 p>a . Let Y and 
{Mt : t E Z} be as in (15, 3j) . Equation (|5.2I) will follow if we can show that 
(5.4) 

/ Xn X— o A* 
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for every bounded and uniformly continuous function / : R s+i+2 — > R. For 
s = 0, equation (|5.4p follows from Theorem 12.31 and the representations of 
a BFTC(a, p) in ([43]) and P~2j) for < p < 1 and (|PJ) and (|43J) for p = 1. 
For s > 1, a function / : M s+ ' +2 — > M can be decomposed as 

f(y,x- a ,...,x t ) = {f(y,x- s ,...,x t )- f(y,0,x_( s _x ) ,...,x t )} 
+ /(y,0,z_( s _i), . . . ,x t ). 



Hence, if we can show (j5.4j) for integer s > 1 and for functions / that satisfy 



the additional constraint f{y,x. 



as soon as x. 



0, then by 



an induction argument, (|5.4p must be true for general /. 

Take integer s > 1 and t > and let / : M s+ ' +2 — > R be a bounded 
and uniformly continuous function such that f(y,x- s , . . . ,xt) = as soon 
as x_, = 0. Fix 5 > 0. We have 



(5.5) E 



/ 



\Xn\ X_ 



X* 



x ' \X \ ' ' \X \ 



E 



X \ X- 



X \ > x 

x t 



f 



x \X \ 

x \ x. 



\x< 



1(|X_ S | < 5x) 



\Xn\ > X 



x t 



X ' \Xn\ ' ' \Xn 



l(\X_ s \>5x) 



\Xn\ > X 



L 0| 1^-0 1 

The first term on the right-hand side of (|5.5p is bounded by 

sup{\f(y,x- s ,...,x t )\ :y> 1, x € R s+t+1 , \x_ s \ < 5}, 



which converges to zero as 6 [ by the assumptions on /. By stationarity, 
the second term on the right-hand side of (|5.5p is equal to 



pq^oi > sx) 

P(|*o| > x) 



E 



\XJ Xn 



X 



s+t 



x \X, 



IX, 



l(\X s \>x) 



\Xn\ > Sx 



As x — ► co, this converges to 



<T a E 



/( SY\M S \, 
i 



Mo M ^M 1{ | Ms | >(Jy) -i } 



r 5~ a 



E 



o 



Af s |' |M. 



M 

IMJ 



M, 



s+t 



M, 



E 



-l/a 



M, 



IMJ 



M, 



l(\Mj a > 6- a u) 
dv. 



du 
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By fj4.6j) and dominated convergence, the latter integral converges as 5 [ 
to 

M M s+t v 



E 



f[v-^ a \M a l 



M, 



|M, 



1(|M S | Q >«) 



dv. 



By the preceding arguments, the integral above must be equal to the limit 
on the left-hand side of (|5.4p ; so it suffices to show that the integral above 
is also equal to the right-hand side of (|5.4|) . 

Change variables y = v~ 1 / a \M s \ to rewrite the above integral as 



E 



fly 



M. 



s+t 



|M S |'-"' \M S 



d(-^°). 



Apply Proposition 14.21 to simplify this expression to 

/oo 
E[f(y, M_ s , . . . , M t )]d(-y- a ) = E[f(Y, M_ s , ..,!,)], 



as required. 



□ 



If < p < 1, then the tail chain {Mt} in (I5,3j) (iii) admits the represen- 
tation in equations (|4,ip to (|4.3p with 

C(Xi/X \X >x) ~> C(A{) = C(HeiA)), 

C{X l /X G I X < -x) ~* = £(0(ei,-l)), 

£(X_!/X | X > x) - 

£(X_!/X | X < -x) ~> 

ass-* co. On the other hand, if p = 1, then the tail chain {Mt} in (|5.3p (iii) 
admits the representation in (|4.4fl and (|4.5jl with C{A±\) as above. 



6 Multivariate regular variation 

Under the conditions of Theorem [521 the finite-dimensional distributions of 
the chain {Xt} are multivariate regularly varying (Theorem 16.11 and Corol- 
lary 16. 2p . We also identify the extreme value attractors of random vectors 
of the form (uqXq, . . . , (JtX t ), where cr, £ {—1,1} for i = 0, . . . , t (Corollar- 
ies E3 and ED . 

Recall that a positive, measurable function V defined in a neighbourhood 
of infinity is regularly varying of index r £ 1 if lim^^oo V(xy)/V(x) = y T 
for all positive y; notation V £ 7Z T . The law of a random vector • • • , £d) 



HEAVY-TAILED MARKOV CHAINS 



17 



is multivariate regularly varying if there exists V £ TZ~ a with a > and a 
non-trivial Radon measure fi on E^ = [—00, 00] d \ {0} such that 

(6.1) y^?[{x~ l ii,---,x~ l £ d ) £ fi, x -> 00, 



the arrow denoting vague convergence of measures 14], section 3.4]. Equiv- 
alent definitions of multivariate regular variation can be found for instance 
in Resnick 0, p. 69] or Basrak et al. [l| . The limit measure \i in (|6.ip is nec- 
essarily homogeneous of order —a. In particular, hyperplanes perpendicular 
to the coordinate axes do not receive any mass, that is, fi({x : X{ = z}) = 
for all i = 1, . . . , d and z € [—00, 00] \ 0. 

According to Theorem 16.11 below, the law of (Xq, . . . , X t ) is multivariate 
regularly varying for every integer t > 0. The limit measure m can be 
expressed in terms of the tail chain {Mj}. To this end, it is convenient to 
partition Ej + i in one of the following two ways, 



t 

IT* 

HA 



(6-2) Et+i = |J ¥ tti = |J 

where, for i = 0, . . . , t, 

E t ,j = {Oo, • • • , x t) ■ x = . . . = Xi-i = 0,Xi / 0}, 
&t,i = {(x , ■ ■ ■ ,x t ) : Xi ^ 0,x i+1 = . . . = x t = 0}. 

Theorem 6.1. Under the conditions of Theorem \5.Sh for every integer 
t > and as x — > 00, 

(6-3) — -i— -PKx^Xo, x^Xt) £ • ] A m 
P(|X | > x) 

in Et+i, where fit is determined by 

/ fdfit = / E[f(zM ,...,zM t )]d(-z~ a ), 
•M,o -JO 
p poo 

/ fdfit = / E[/(0,...,0,*M ,... ) zM t _ i )l(M_ 1 = 0)]d(-z" Q ) 

/or i = 1, . . . , t, and also by 

/ fdfit = / E[f(zM^ t ,...,zM )]d(-z- a ), 
JG t ,t JO 
p poo 

/ fdfit = / E[/(zM_ 4 ,...,zM ,0,...,0)l(M 1 =0)]d(-z- Q ) 
/or i = 0, . . . , t — 1. 
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Proof. Let / : 'Et+i — > R be continuous and with compact support. We have 
to show that 

(6.4) lim p ,. * Eifix^Xo, x^Xt)] = [ fdfi t , 

a;— >oo F{\Xq\ > X) J 

where the latter integral can be computed according to one of the two par- 
titions in (|6.2|) and the corresponding formulas in the theorem. 

The assumption that the support of / is compact means that there exists 
e > such that f(xo, ■ ■ • , x t ) = if < e for all i = 0, . . . , t. Take 
< 5 < e. We have 

E[f(x~ l X G ,...,x- 1 X t )} 

= E[f{x- 1 X Q ,...,x- 1 X t )l(\X Q \>5x)} 

t 

+ Y / Hf(^ 1 Xo,---,x~ 1 Xt)HV i j ~ = 1 \X J \<5x,\X i \>5x)}. 
i=l 

On the one hand, 

lim ] E[f{x- 1 X ,...,x- 1 X t )l(\X \>5x)] 

x— >oo i-'dAol > X) 

= lim P ^\ > 8x h \f(x- 1 X 0t ... 1 x- 1 X t ) | \X \>5x] 

x^oo P(|A | > x ) 

= 5~ a E[f(5YM ,...,5YM t )] 

/oo 
E[f(5yM ,...,5yM t )]d(-y- a ) 

poo 

= / E[f(zM ,...,zM t )}d(-z' a ). 
Js 

On the other hand, for i = 1, . . . , t, by a similar argument, 

lim 1 Eifix^Xo, . . . ^-^W.-fel < Sx, \Xi\ > 6x)\ 

x-^oo r(|Ao| > x) J 

poo 

= / E[f(zM_ h . . . ,^M t _i)l(V7i-il^il < S/z)]d(-z- a ). 
J 8 

We obtain that for arbitrary 5 € (0,e], the limit on the left-hand side of 
()6.4p is equal to 

POO 

J E[f(zM ,...,zM t )d(-z- a ) 

t poo 

+ E[f(zM- i ,...,zM t - i )}l(yjL i \M j \<5/z)]d(-z- a ). 
i=i 
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Take the limit as 5 [ and apply the dominated convergence theorem, 
which is justified by (|4.6p and the fact that / is continuous and has compact 
support, to see that the limit on the left-hand side of (|6.4p is also equal to 



POD 

/ E[f(zM ,...zM t )]d(-z- a ) 
Jo 

+ V/ E[/(0,...,0,zM o ,...,*M i )l(M_ 1 = 0)]d(-z- Q ). 
i=i Jo 

The last expression coincides with the stated expressions for f fdfit via the 
partition of Et+i into F^o U • • ■ UF^ f The proof of the expressions for J fdfit 
via Qf,i is completely similar. □ 

Corollary 6.2. Under the conditions of Theorem [570$ ifV{M\ = 0) = 
or, equivalently, E[|M_i|] a = 1, then for \xt-integrable f, 

/poo 
fdfit = J E[f(zM^ t ,...,zM )]d(-z- a y, 

and i/P(M_i = 0) = or, equivalently, E[|Mi|°] = 1, then 

/f'OC 
fd^t = J E[f(zM ,...,zM t )}d(-z- a ). 

COROLLARY 6.3. Under the conditions of Theorem \5.^ for every integer 
t > and all xo, . . . , x t G K, 

P(x X > x or . . . orx t X t >x) 
l t (x , ...,x t )= hm 



P(|X | > x) 
is equal to 

t 

E[(x M )^ V • • • V {x t M t )%] + n{(xiM )% V • • • V (x t M t _i)^}l(M_i = 0)] 

i=i 

and a/so to 

t-i 

E[(x M_ t )° V • • • V (x t M )?] + E[{(x M_,)^ V • • • V (^M Q )^}l(Mi = 0)]. 

As in Corollary 16.21 the expressions for It in Corollary 16.31 simplify con- 
siderably if P(M_i + 0) = E[|Mi| Q ] = 1 or P(Mi / 0) = E[|M_i| a ] = 1. 
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Corollary 6.4. Under the conditions of Theorem \5.SX if the sequence 
{a n } is such that limj^oo nP(|Xo| > a n ) = 1, then for integer t > 0, o~i € 
{— 1, 1} and Xi G (0, oo) (i = 0, . . . , t), 

lim {P(a X < a n x , . . .,a t X t < a n x t )} n = exp{-lt(a /x , . . .,a t /x t )}. 

n—>oo 



7 Examples 

Examples 17.11 to 17.31 illustrate the theory to ARCH(l) processes, more gen- 
eral stochastic difference equations, and a process inspired by Example 3 in 



Smith [la, p. 43], respectively. Examples 17.41 and 17.51 are counterexamples 
illustrating some surprising phenomena that can occur if the first or the 
second part of Condition 12.21 are not fulfilled. 

Example 7.1. Let < (3 < oo and < A < 2e 7 where 7 is Euler'c 
constant, and consider the ARCH(l) process 

(7.1) X t = (P + \X?_i) 1/2 Zt, * = 1,2,.-. 

where Xq, Z\, Z2, ■ ■ ■ are independent random variables and the common dis- 
tribution of the Zt is standard normal. By Kesten [lOj, Theorem 5] or Goldie 
0, Theorem 4.1] to the squared series Xf, a stationary solution to (|7.ip ex- 
ists, and this stationary distribution satisfies Condition [2J] with p =1/2 and 
a equal to the unique positive solution to the equation E[A Q / 2 |Z| a ] = 1; see 
also Embrechts et al. |6j, section 8.4.2]. Condition 12.21 is easily verified with 
4>{z, ±1) = zbA 1 / 2 ^. The back- and- forth tail chain is given by Theorem 15.21 
and, by symmetry of the normal distribution and Example 13.61 it can be 
represented by 

M t = M< s \ tl2 Z 1 ---Z u 
M- t = M \- t/2 Zl---Z;, 

for integer t > 1, where Mq, Z\, Z*, Z2, Z%, ■ ■ ■ are independent random vari- 
ables with P(Mo = 1) = 1/2 = P(Mo = —1) and Z% standard normal and 
with the common law of the variables Z* related to the standard normal 
distribution via 

E[f(Z* 1 )]=X a / 2 E[f(l/Z 1 )\Z 1 n 
for Z^-integrable functions /. By Corollary 16.31 f° r an integer t > and all 
real x ,... ,x t , 

P(xqXq > x or ... or XfX t > x) 
lim : 

^00 P(|X | > x) 



^E[v; = o{^ S ign(xo)A^ 2 ni =1 ^};], 
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from which the domains of attraction of (Xq, ... ,Xt) in all 2* +1 corners of 
1R* +1 can be derived. 

Example 7.2. Let Xq, Xi,X2, ... be defined recursively by the stochas- 
tic difference equation 

(7.2) X t = AtXt-x + B t , 4 = 1,2,... 

where (A\, B\), (A2, B2), ■ ■ ■ are independent and identically distributed bi- 
variate random vectors, independent of Xq- By Kesten [l(J and Goldie 
0, Theorem 4.1], a stationary solution to (|7.2|) exists provided £(log|^4i| | 
A\ 7^ 0) is non-lattice and there exists < a < 00 such that E[|Ai| Q ] = 1, 
E[|j4i| Q (log A{)%] < 00 and E[|5i| a ] < 00. Moreover, the stationary distri- 
bution satisfies 

lim x a P(±X t >x) = C± 

x^oo 

with C+ and C_ as in Goldie 0, equation (4.3)], and C+ + C_ > if and 
only if P[Bi = (1 — A\)c\ < 1 for each c£l. Obviously, if A\ and B\ are 
nonnegative, as in the case of a squared ARCH process [21], then C_ = 
and thus p = 1. 

Under these assumptions, Condition 12.11 is satisfied with the given a 
and with p = C+/(C_ + C+), and Condition 12.21 is satisfied with, in obvi- 
ous notation, 0((o, 6),±1) = a. The back-and-forth tail chain is given by 
Theorem 15.21 the forward tail chain admitting the representation 

M t = MqAi ■■■ A t , 4 = 1,2,..., 

where Mq, A±, A2, ■ ■ ■ are independent random variables with P(Mo = ±1) = 
C±j (C + + C_) = p(±l) and A\,A2, ... as in (|7.2|) : the backward tail chain, 
however, does in general not admit such a multiplicative random walk rep- 
resentation and its distribution is to be obtained through (|4.3p . 

By Theorem 16. 1} the joint distribution of (Xq, . . . , Xt) is multivariate 
regularly varying, and since E[|Mi| a ] = E[|^4i| a ] = 1, the limiting measure 
fH in (|6.3p admits the simple expression in (|6.6p . A useful special case is 
that for integer t > and for non-zero xq, . . . ,xt, 

P(xoA~o > x or ... or xtX t > x) 
hm — : r 

x-00 P(|X | > x) 

= p(signxo)E[V* =0 {^ sign(xo) Y\\ =l A l } a { ] . 



For nonnegative At and positive Xi, this relation was already established in 
Gomes et al. @, Corollary 2.1]; see also Basrak et al. 0|. 
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Example 7.3. Let Xq, Zi, Ji, Z2, J2, ■ ■ ■ be independent random vari- 
ables such that the common distribution function, F, of Xq, Zi, Z2, ■ ■ ■ is 
continuous and such that J\,J%,... are equal in distribution with P(Jt € 
{—1,0,1}) = 1. Denote P(Jt = j) = Pj for j € {—1,0,1} and assume 
Po > 0. Let Q be the quantile function of F and define X t for integer t > 1 
recursively by 

f *t-i if Jt = 1, 

(7.3) X t = \ Z t if J t = 0, 

[ Q(l-F(X t _i)) if J t = -1. 

The process {X} is a stationary Markov chain. 

Now assume that the stationary marginal distribution F satisfies Con- 
dition [2J] for some < a < 00 and some < p < 1. By the special form of 
the chain, Condition 12.21 is then automatically fulfilled as well with 

f 1 if j = l, 

<f>((z,j),±l) = \ if J = 0, 

I -{(1-P)M ±1/Q if j = -L 

The back-and- forth tail chain of {Xt} is given by Theorem 15.21 in terms of 
the representation in (|4.ip to (|4.3p . we have 

£(Afcl) = Plft. +P0<50 +P-l<L{(l_p)/p}l/a, 

C(B±i) = p x 8\ +po5o +P-l*_{p/(i- p )}i/a, 

see also Example 13.41 The fact that the forward and backward chain are 
equal in law is a consequence of the fact that the time-reversed process 
{X_t} has the same distribution as the original one. 

Example 7.4. Consider again the chain {Xt} defined in (|7.3p and as- 
sume that the stationary marginal distribution satisfies Condition 12.11 for 
some < a < 00 but now with p = 1. Although the first part of Con- 
dition E21 equation (|2.3j) . is fulfilled with <f>((z, j), +1) = 1 if j = 1 and 
(j)((z, j), +1) = if j € {—1,0}, the second part, equation (|2.4p . is not, as 
lima;—,.^ Q(l — F(—x))/x = 00. The theory therefore breaks down: although 

CiXjXo I X > x) ~> C(Ax) = piS! + (po +p_i)<*o 

as x — >• 00, the forward tail chain is not equal to a multiplicative random walk 
with independent increments with common distribution C(A\). Instead, if 
for instance p\ = 0, then for integer t > 1 and as x — > 00, 

C(X t /X , . . . , X 2t /X I X > x) ^ C(0, d, 0, dC 2j . . . , 0, UUid) , 
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where C\ , C2, ■ ■ ■ are independent Bernoulli random variables with succes 
probability p 2 _ 1 . 

Example 7.5. Let Vq, Jo, Wi, J\ , W2, J2, ■ ■ ■ be independent random vari- 
ables such that P(Vb < x) = P(W t < x) = exp(-l/z), P(J = 1) = 1/2 = 
P(io = 0) and P(J t = 1) = it = 1 - P(J t = 0) for real x > and integer 
t > 1 and some < 7r < 1. Further, let < ao < ai < 1. Define (Vf,it) for 
t = 1,2,... recursively by 

max{aj t _ 1 Vt_i, (1 - aj^jWt}, 

f It-i ifJt = l, 
\ 1 - 7 t _i if J t = 0. 

The process {Vt} may be thought of as a max-autoregressive process with 
parameter depending on a latent variable It- The process {(Vt,It)} forms a 
stationary Markov chain on (0, 00) x {0, 1}. Next, put 

X t = Vt+[Vt\+I t , t = 0,1,2,..., 

where |_^J is the integer part of a real v. The map (v, i) ^ v + \v\ + i \s 
a bijection from (0, 00) x {0, 1} to (0, 00), the inverse map being x 1— > (v, i) 
where v = [x/2\ + x — \_x\ and i is or 1 depending on whether \x\ is even 
or odd. Hence, {Xt} is a stationary Markov chain on (0, 00). 

Condition 12.11 is satisfied with a = 1 and p = 1. However, the first 
part of Condition 12.21 equation (|2.3I) , is not satisfied since the conditional 
distribution of X t given X t -\ is strongly affected by whether |Xt-lJ is °dd 
or even through the value of ai t _ 1 - The conclusion of Theorem 12.31 is not 
satisfied either unless tt = 1/2. In fact, for integer t > 1, 

X >x^j ~*C(Y,Mi,...M t ) 

as x — * 00, where Y is independent of M\, M2, ■ ■ ■ and with distribution 
P(y > y) = y~ l for y > 1, and where Mt = A\ - ■ ■ At with ^ = a/ t 
for integer t > 1. Since the process Iq, I±, I2, ■ ■ ■ is a stationary Markov 
chain on {0,1} with transition matrix determined by P(Ij = It+i) = vr, 
the variables Ai,A2,... form a stationary Markov chain on {ao,«i}. The 
variables A\,A2,--- are not independent unless n = 1/2. 
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